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Background of the Invention 

[0001] Combinatorial Optimization-. In many areas of engineering arise Combinatorial 

Optimization (CO) problems (e.g., industrial control, integrated circuit design, artificial 
intelligence, chemical processes, etc). In CO, a solution of minimum cost must be 
found among a large number of possible configurations. The set of such 
configurations is denominated solution space. Usually, the solution space grows 
exponentially with the size of the problem, and the exploration of the whole solution 
space becomes unapproachable for moderate problem instance sizes. Therefore, a 
discriminatory search must be performed to approximate to the optimal solution. 

[0002] 

There are different methods to treat Combinatorial Optimization problems. A main 
classification can be established between general and specific methods. General 
methods are intended for a wide spectrum of problems, while specific ones are 
problem oriented. In this work, we are interested in general Combinatorial 
Optimization methods. Among them, local search or iterative improvement is widely 
aapplied. The main idea consists of performing local transformations from an initial 
configuration. Transformations with cost-decrements are accepted, while 
transformations with an increment in the cost are rejected. The main drawback of the 
basic local search method is that the optimization usually gets stuck at a local 
minimum. There are other general methods that allow the search to escape from local 
minima. Among them, Simulated Annealing (SA) is one of the most successful 
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methods. Unlike the basic local search, SA is a probabilistic combinatorial 
optimization method. Its probabilistic nature allows SA to escape from local minima. 

[0003] Simulated Annealing-. SA is based on the analogy between combinatorial 

optimization problems and the problem of determining the lowest-energy ground 
state of solids. The annealing is a widespread process performed in the industry to 
achieve this goal. A similar process to the annealing of solids can be simulated to 
solving combinatorial optimization problems. The simulated annealing process 
consists of first melting the system being optimized at a high effective temperature, 
then lowering the temperature by slow stages until system freezes and no further 
changes occur. SA is carried out in practice by slight modification of the local search 
method. Thus, SA local transformations decreasing the cost are always accepted, but 
unlike common local search, SA transformations with an increment in the cost are 
accepted according to a probability based on the Boltzmannfactor 

[0004] exp(- A C/T) 

[0005] where A C is the cost variation and T is a parameter denominated temperature. 

[0006] Since an annealing process is carried out, a high initial value of the temperature 
must be selected, and then the temperature is lowered slowly. Thus, the simulation 
must proceed long enough at each temperature for the system to reach a steady state. 
The sequence of temperatures and the number of solutions attempted to reach 
equilibrium at each temperature can be considered the annealing schedule. The 
annealing schedule is a key issue for SA success. There are some theoretical studies 
proving the asymptotic convergence of the SA to the optimal solution for determined 
annealing schedules. Nevertheless, such asymptotic requirement predicts infinite 
transformations to guarantee the global optimum solution. In practice, real life 
problems are time constrained, and a common goal is to reach good solutions within 
the available time. So, fast annealing schedules are usually applied as Fast Annealing, 
or the exponential temperature decrease given by 

[0007] T =aT with 0<a<l 
i+1 i 

[0008] Although SA has been successfully applied to many combinatorial optimization 
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problems, a large number of empirical studies are required in parameter adjustments. 
Some attempts to automatically determine the annealing schedule have also been 
carried out. For example, Adaptive Simulated Annealing proposes an exponential 
formula for the annealing schedule depending on the dimension of the problem. Also, 
in Generalized Simulated Annealing the temperature depends on the cost of the 
solution explored. Although some of these variations of SA produce excellent results, 
they usually require some previous knowledge of the problem. Above considerations 
make SA a method whose best results depend upon the skillsor experience of 
practitioners. 

[0009] Thermodynamics.- Classic Thermodynamics focuses on energetic transformations 
of macroscopic physical phenomena related to heat and temperature. Its field of 
application is restricted to equilibrium states and transformations represented by 
series of equilibrium states. A system is regarded in thermodynamic equilibrium, 
when it achieves a state where the macroscopic variables that characterize the system 
reach constant values. 

[0010] Thermodynamics studies physical phenomena from the macroscopic point of view 
based on observable properties. A system is defined as a part of the space and its 
content, and the description of the system state is performed by a set of macroscopic 
properties denominated variables or thermodynamic coordinates. The set of 
independent variables needed to characterize the system is denominated state 
variables. The rest of variables of the system can be represented as a function of 
them. A function that can be expressed by means of state variables is denominated 
state function of the system, e.g. internal energy, entropy, etc. The variation of a state 
function only depends on the initial and final states, and it does not depend on the 
process connecting the two states. 

[0011] 

A system undergoes a process or thermodynamic transformation when any 
variable characterizing the system changes. The initial and final states are regarded in 
equilibrium. A process is denominated quasistatic when the intermediate states are 
also equilibrium states. The process is reversible when a slight variation on external 
conditions makes possible, to reverse a quasiestatic transformation. And the process 
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is irreversible when the intermediate states are not equilibrium states. The efficiency 
of a reversible transformation improves any other transformation performed 
irreversibly. 

[0012] Thermodynamics rests on three laws from which all thermodynamic rules are 
derived. We will be interested in the first and second laws. The first law of 
thermodynamics is expressed as 

[0013] A U=Q-W 

[001 4] where A U is the internal energy variation, Q the interchanged heat, and W the 
work performed in a transformation. The second law determines the direction of 
thermodynamic processes and the equilibrium state of physical systems. The 
mathematical expression of the second law applied to a reversible transformation 
performed at temperature T is given by 

[0015] AS=Q /T 
R 

[001 6] where A S is the entropy variation, and Q the heat nterchanged 

R 

Summary of the Invention 

[001 7] In many areas of sciences and engineering arise Combinatorial Optimization (CO) 
problems. Simulated Annealing (SA) is a general method emerged to solving a large 
diversity of CO problems. In spite of SA success, it is a method whose best results 
depend upon the experience of practitioners. Thus, one of key issue of SA is the 
temperature schedule. Usually a large number of empirical studies are required in 
fine-tuning the temperature schedule parameters. 

[001 8] The present disclosure contains the Thermodynamic Simulated Annealing 
Schedule (TSAS) method. Such method provides a thermodynamic temperature 
schedule for Simulated Annealing, in TSAS, the temperature is updated all along to the 
ratio between the accumulated cost and entropy variations. The accumulated entropy 
variation is measured as the sum over all previous Simulated Annealing iterations of 
the natural logarithm of the probabilities of acceptance applied. 
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[0019] TSAS is derived from the application of the first and second thermodynamic laws 
applied to reversible processes. A key feature of reversible processes is just that 
intermediate states of a transformation are also equilibrium states. Moreover, since 
the efficiency of a reversible transformation improves any other transformation 
performed irreversibly, a cooling of the system performed reversibly theoretically 
achieves the maximum efficiency. This method allows simulated annealing algorithm 
to perform a cooling close to equilibrium missing out the need of expensive 
experimental adjustments. TSAS present interesting adaptive features while providing 
high quality solutions. 

Brief Description of Drawings 

[0020] FIG. 1 compares the optimization development for an instance of the integrated 
circuit placement problem with: 

[0021] a) the common simulated annealing schedule T =aT with 0<a<1 

k+1 k 

[0022] b) Thermodynamic Simulated Annealing Schedule 

Detailed Description of the Invention 

[002 3] Thermodynamic Simulated Annealing Schedule. - One of the theoretical basis of SA 
consists of reaching equilibrium at each temperature. In order to achieve this goal, the 
annealing schedule of SA goes along a sequence of temperatures for cooling the 
system, while a number of rearrangements are attempted to recover equilibrium at 
each one (i.e., the system does not achieve equilibrium if temperature is lowered too 
quickly). A main concern of SA practitioners is how slowly it should be the cooling to 
avoid the search gets stuck in local minima. That is, how large temperature steps 
should be, and how many moves should be performed to recover equilibrium at each 
temperature. Both parameters, the magnitude of temperature drops, and the number 
of movements performed at each temperature are usually adjusted experimentally for 
each cost function. 

[0024] Thermodynamic Simulated Annealing Schedule (TSAS) provides an alternative 
method to perform the cooling close to equilibrium missing out on experimental 
adjustments. TSAS is derived from the first and second laws of Thermodynamics 
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applied to reversible processes. A key feature of reversible processes is just that 
intermediate states of a transformation are also equilibrium states. In the rest of this 
section, we deduce the annealing schedule subjected to the optimization process is 
reversible. 

[0025] On one hand, the first law of thermodynamics for systems that only interchange 
heat with surroundings and do not perform work takes the form 

[0026] U -U =Q 
B A 

[0027] On the other hand, the second law of thermodynamics for a reversible process 
performed between two states at temperature T can be expressed as 

[0028] S -S =Q /T 
B A R / 

[0029] Therefore, a reversible process (suffered by a system at temperature T) that only 
interchange heat with surroundings should meet 

[0030] S -S =(U D -U )/T 
B A B A 

[0031] Finding T and making the equivalence between Internal Energy (U) and Cost of a 
solution (C) for combinatorial optimization problems we have 

[0032] T=(C -C )/(S -S WEq.l) 
B A B A 

[0033] Thus, the value of T given by Eq.l ensures that the transformation between the 
states A and B has been performed reversibly. Now, we are going to find the 
expression for the entropy variation of Eq.l . 

[0034] According to the information theory, the information ( A I) obtained in the 

reception of a message of probability P is equal to 

i 

[0035] AI=-ln(P ) 
i 

[0036] In the same way, the Entropy variation due to a reversible transformation between 
the states A and B will be 

[0037] S B -S A =ln(P AB ) 
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[0038] Now, assume a reversible transformation between the states A and B performed in 
k iterations. Let P . be the probability of acceptance for the transformation attempted 
at the iteration i. Then 



[0039] 

-Up, 

i=l 



[0040] Therefore 



[0041] 



i=l 



[0042] or 



[0043] 



S e -S A =±lnP, 



[0044] Substituting the entropy variation (Eq. 2) and the cost variation in Eq. 1 , we have 
the thermodynamic annealing schedule given by 



[0045] 



T -k C Q~ C k 

2 k+l ~ K a — 



[0046] 

where C is the initial cost, C , the current cost, and K is a parameter 
Ok a 

introduced to control the run-time/quality tradeoff. Note that, to avoid singularities 

and force the minimization, this equation must only be applied when both, C <C 

k 0 

and the entropy variation is different from zero. Otherwise the initial temperature T 
must be applied. We can also distinguish two functional modes: adaptive and normal, 
in adaptive mode (that must be applied when the search starts from a halfway 
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solution) the initial temperature is set to zero. In normal mode the initial temperature 
can be selected to a non-zero value. This mode can be applied when the search starts 
from a random configuration. 

[0047] Figure 1 shows an example of the optimization development with Thermodynamic 
Simulated Annealing Schedule with respect to a common Simulated Annealing 
schedule (T =aT . 0<a<1) for the integrated circuit placement problem. Note that 
the cost with TSAS drops faster while preserving the solution quality. 

[0048] Finally, we can summarize saying that Thermodynamic Simulated Annealing 

Schedule is an annealing schedule that adapts automatically to different problems and 
cost functions while providing high performance. 
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